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to data — >«n. Mo» spe^^c^, ^ 
U, *e sUBamIng cf media eontenl tn a Multimedia Messaging Ser«ce. 

' H, mob»e oomm«nlca.U>ns nehvort^. *e .em, Multimedia Messaging Sa™« 
<MXt oommonly used to descHt« a new approa* .or .»nsml«.ng messages 
'Zl muKUnedla content T.a MuKlmedla Messaging Sen,^ "^^^ 
belw^n differen. mobile users and / or between mobile users a.- the lMem«^ 
0 CTls an already agreed soluBon *.r prcvld^rg a MuHlmedIa 

^3- Genen^ mob»e communication networtcs and «s ^'^'^^^^ 
3« Gener-ion Partnership Pmiect (3GPP, Technical Spec^-«°n ^S) 
■MulUmedla Messaging Semes (MMS), Functional Descnptton. Stage 2 ^ 
MuHtmedla Messages Sen.ce pmposed 3GPP TS 23.140, employs a s»«. 
,5 riforward appmaoh to message deliveiv Multimedia messages consm^ted 
rjr. way *a, the media content (media components,. lnn,m,at,on neces^ 
L media content addressing ln.om,ation, Wenttfy^g me ..^^ 
^iver o. the message, are encapsulated together. The multim«l,a nnessage .s 

-i™ MMS user aaent to a recipient MuHlmedia Messaging 
then sent from a sandng MMS user agent maty , . . 

20 service ,«lay / server, which ir. turn notifies the lr.ter.cled receiver (recp.ent MMS 
^L'tgTnt) about the availability of the message. Later or., the mummedla 
ZZ l selected media components, are downloaded by the reclpler.. MMS 
user agent temilnal and presented to the user of the terminal. 

25 The stn^cture and operation of a typical MMS system as proposed In 3GPP TS 
23.140 Will next be described with reference to Figures 1 and 2. 

ng. 1 shows an overview of MMS system elemertts according to 3GPP TS 23.140. 
The system comprises the following Hems: 
30 . a plurality of MMS user agents (UAs) 110. each of which Is capable of 
transmitting and receiving multimedia messages: 
• a roaming MMS user ag nt 127: 



14/11 '02 18:48 FAX 01252 8B5080 NOKIA IPR DEPARniENT -» UK PO @|005 



Aco ss networte 122. 124 and 126 of different types including: 

. A second generation mobile telecommunications network 122 such as a 

GSM phase 2 network; 

• A third generaUon mobile telecommunications network 124 such as a 
5 Universal Mobile Teleeommunlcations System (UMTS); and 

• A mobile accees network 1 26. for example a wireless-LAN network. 

. The internet (or another Internet Protocol OP) -network) 130. having an 

external sen/er 134, such as an e-mail sender, and a wired e-mail client 1 32; 
. A MuHimedia Messaging Senrice relay 142 and an MMS senmr 144 which, in 
10 this example, are Integrated into a single unit. refen«d to as a Multimedia 
Messaging Sen*» Centre (MMSC) 140, but which can alternatively be 
Implemented as separate or distributed entities: 
• A message store 150 In connection with the MMS sender 144; and 
. User databases 1 60 comprising, for example, user subscription and addressing 
15 Information. 

The collective term Multimedia Messaging Service Environment (MMSE) is used 
- to describe those functional elements that operate together to implement a 
multimedia messaging service. In Fig. 1. an MMSE is fomned by the elements 
20 within the oval outlined region. 

Referring in further detail to Rg. 1, each MMS user agent 110 connects to the 
MMS relay 142 through Its access networic 122, 124. The roaming MMS user 
agent 127 connects to the MMS relay 142 through the mobile access network 126 
25 and via the Internet 130. The MMS relay is connected to the MMS sender 144 and 
to the user databases 160. Furthemnore. the external seroer 134 and the wired e- 
mail client 132 are connected to the Internet 130. 

Fig. 2 shows an ovewiew of Inter^rklng between different MMSE's according to 
30 3GPP TS 23.140. The communication of multimedia messages takes place 
between user agents 110A (sender) and 110B (recipient) which reside in two 
diff rent Multimedia Messaging Senrice Environments. For simplicity and clarity, 
the two Multimedia Messaging Sen^ice Environments. MMSE A and MMSE B, are 
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each shown to comprise a single MMS relay. linked to a single MMS seiver. thus 
fonning two MMSC's 214 and 224. It should be app-Bciated that in a practical 
MMSE. the number of MMS relays and sen/ers may be, and typically will be. 
greater than this. MMSE A and MMSE B may. for example, have drffer^nt 
5 operators. diffeiBnt geographical locations or coverage areas and / or differ In 
terms of their technical characteristics and capabilities. Furthermore, in the 
Situation where a particular MMSE comprises more than one MMS relay, the 
method aooordinfl to the Invention can also be applied within the MMSE Onlra- 
MMSE). 

10 

In the example shown in Fig. 2. both MMS user agents 110A and 110B are 
depicted as devices that communicate with their respective MMSE 210. 220 via a 
radio communication networi. 212. 222. However, it should be appreciated that 
either MMSE user agent A or MMSE user agent B. or both of them, could reside .n 
15 a fDced line network (not shown) . 

No particular restrictions are placed on the type of media content that may be 
included In a multimedia message. In general, the media components may toe 
classified as belonging to one of two categories, namely. 1) those suitable for 
20 streaming to the recipient user agent and 2) those which are typically not suitable 
for streaming. Examples of media components that fall within the first category are 
audio and video clips, while media components typical of the second, non- 
streamable category Include, for example, text and still images. The temi 
-streaming- is generally used to describe the presentation of media content, or a 
25 combination of different media types, in a continuous way while the content is 
being trensmltled to a recipient over a data network. Thus, a "stream" is a flow of 
data enabling the recipient to present some fom. of continuously evolving 
infbmaation. such as the audio or vWeo clip referred to above. In practice, 
streaming can be either live, or performed in an on-demand fashion. The temi Tiv 
30 streaming" describes the creation of a media stream from a live source, for 
example a stream of digital Images produced in real time by a video camera, while 
the term Wemand streaming" descn-bes the creation of a media stream from, 
for example, a file comprising encoded (compressed) audio or video data stored 
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on a server. 

The use of streaming in mobile networks is potentially very beneficial. Typically 
mobile terminals have limited memory and processing power and mobile 

5 communication networks may also have limited data transfer rates. Thus, adoption 
of a streaming approach to media download and presentation can reduce the 
amount of available memory required by mobile terminals and may also reduce 
the delay In starting playback of a media component. For these reasons, there lias 
also been Interest In the incorporation of streaming Into the 3"* generation 

10 multimedia messaging ser>rice. 

In order to download a streamable media component by streaming it is necessary 
to establish a so-called "streaming session" between the recipient tenmirial and the 
source of the media ccaitent. To establish a streaming session, the recipient 
15 terminal must know certain infonnnation about the media content to be streamed. In 
general, this information may include, but is not limited to, the type of the media 
content, the fomiat in which it Is encoded, the transport mechanism to be used in 
streaming the content to the recipient and the location (e.g. network address) from 
which the content is to be downloaded. This information, which the intended 
20 recipient must know In advance in order to establish a streaming sessnn. Is 
typically referred to as "Session Description Data" (SDD). As previously explained, 
according 3GPP TS 23.140, a multimedia message Is fomned by encapsulating 
media content, information necessaiy to describe the media content and 
addressing Infonnation, identifying the intended recipient of the message, into a 
25 single message structure. This approach to message construction is inherently 
incompatible with the streaming downtoad of media content, as there Is no way for 
a recipient MMS user agent to obtain the SDD it requires to establish a streaming 
sesston before the multimedia message has been downloaded in Its entirety. 

30 For this reason, earlier versions of 3QPP TS 23.140, such as V.3.1 .0 (release "99), 
did not provide support for the streaming download of media content to a recipient . 
MIS/IS user agent. AH media components, streamable and non-streamable, were 
simply delivered to the recipient MMS us r agent and only presented once 
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downloading oi the entire message was complete. 

■n^e basic mechanism of Multimedia Message delivery according to 3GPP TS 
23 140 V.3.1.0 will now be described m greater detail with reference to Fig. 2. 
Here it is assumed that MMS user agent A 110A, which has subscribed to the 
multimedia messaging sen^ice pn>vided in Multimedia Messaging Sennce 
Environment A 210. wishes to send some media content to MMS user agent B 
11 OB. which has a subscription to the multimedia messaging sen/Ice provided in 
MMSE B 220. When initiating the communication of a multimedia message to 
MMS user agent B, MMS user agent A first selects the media content to be 
transmitted. For example, the media content may be of a non-streamable type, 
sudh as a still image and some associated text, stored in the memory of user 
agent A. or it may be surtable for streaming, such as an audio or video cHp. In 
either c^se. according to 3QPP TS 23.140 V.3.1.0. user agent A encapsulates the 
media content as a multimedia message, comprising the media content itself. 
Information necessary to describe the media content and addressing information, 
Identifying the Intended recipient of the message. MMS user agent A then sends 
. the message to MMS relay A through radio neiworit A 212. 

On receiving the multimedia message. MMS relay A detenmlnes. from the 
addressing infonnation included with the message, that the intended recipient is 
not a user agent of MMSE A. but a user agent of MMS relay B and fon«rards the 
multimedia message to MMS relay B. Routing of the multimedia message to the 
correct MMS relay, i.e. that responsible for MMS user agent B Is achieved, for 
25 example, using slandaidised mechanisms provided for In the existing 3GPP 
multimedia messaging solution. On receiving the multimedia message. MMS relay 
B stores the media content in MMS server B and sends a notification to the 
intended recipient. MMS user agent B. thereby indicating that a muftimedia 
message has anived and its content Is available to be downloaded from MMS 
30 relay B. In response to receiving the notification. MMS user agent B retrieves th 
media content from (via) the MMS relay B. The retrieval of the media content is 
inltiat d by signalling with MMS relay B. 



20 
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3QPP Ts 23.140, V.4-1.0 (Rel ase 4, Decemb r 2000), included provisions for 
nabling the streaming download of media content. It proposed a solution in which 
the SDD, required by a recipient MMS user agent to establish a streaming 
session, was provided in the notification message sent by the recipient MMS relay. 
5 More specifically, according to 3GPP TS 23,140 V.4.1.0, when a recipient IVIMS 
relay, such as MMS relay B, receives a multimedia message containing 
streamable media content, rt foms a modified MMS notification message and 
sends it to the intended recipient user agent to notify it about any streamable 
multimedia components contained in the multimedia message. The modified 
10 notification message contains the SDD necessary to Initialise a streaming session 
iDetween the recipient MMS user agent and an MMS server that has access to the 
streamable multimedia components. 

WO 02/063849 discloses an aitemative method for enabling streaming download 
15 of media components in a multimedia messaging system, which operates without 
the need to modify the notification message sent to the recipient MMS user agent. 
The method proposed in WO 02/063849 forms the basis for the support of 
streaming in the most recent versions of the 3GPP multimedia • messaging 
standard. 

20 

According to the method disclosed in WO 02/063849, a recipient MMS relay 
examines the multimedia messages it receives and replaces any streamable 
media components in the messages with descriptors before notifying the recipient 
user agent at^out the multimedia message. Each descriptor comprises SDD 
25 sufficient to allow the recipient MMS user agent to form a streaming session for 
downloading a particular one of the streamable media components in the 
multimedia message. Alternatively, descriptors comprising SDD for more than one 
streamable component can be used. Advantageously, a descriptor takes the form 
of a Session Description Protocol (SOP) file, a standard format known from 
30 streaming applications in the Internet. WO 02/068349 also mentions the possibility 
that SDD can be provided by means of a Uniform Resource Identifier (URI) or a 
Uniform Resource Locator (URL) inserted into the multimedia m ssage in place of 
a streamable compon nt. in this case, the URI or URL provides information 
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enabling the recipient MMS user agent to retrieve SDD from a locaWon within a 
data communication network, for^example the MMSE Itself or. more generally, the 
Internet. 

6 In WO 02/068349. after receiving the notification, the recipient MMS user agent 
requests delivery of the multimedia message, by sending an MMS retrieve request 
to the recipient MMS relay. The MMS relay then sends an MMS retrieve response 
comprising the modified multimedia message. On receiving the modified 
multimedia message, the recipient MMS user agent can present the non- 
10 etreamable media components and further decide which, if any. of the streamable 
components are to be retrieved. If the modified message comprises the SDD in 
the form of an SDP file, the recipient user agent MMS has immediate access to 
the Infomiation it requires to form a streaming session. If the de8criplor(8) take the 
form of URIs or URI^. the recipient user agent must first retrieve the SDD from the 

15 location indicated by the URi or URL and can then form a streaming session to 
retrieve the streamable component In question. 

According to a first aspect of the invention there is provided a method for sending 
multimedia messages in a mobile multimedia messaging sen/ice to multimedia 
20 messaging user agents, comprising the steps of: 

receiving a multimedia message retrieve request for a particular multimedia 
message from a multimedia messaging user agent; and 
responsive to the retrieve request, perfomiing the steps oft 

obtaining streaming adaptation information of the user agent that requested 
25 the multimbdia message: 

determining if the multimedia message addressed to a user agent 
comprises a component that can be streamed to the user agent; 

generating, according to the adaptation information, session description 
data to establish a streaming sesision 5or delivering the streamable component; 
30 replacing the streamablJ component with a descriptor pointing to the 

session description data for Wie streamable component and sending the 
multimedia message with th descriptor replacing th str amable component to 
the user agent; and 
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©stabfishing a streaming session in accordanc with the session description 
data with the user agent to deliver the streamable component. 

Preferably, the method further comprises receiving a notification Informing that the 
5 multimedia message is available. Preferably the notification conforms to 3GPP 
23.140 MMS specifications. ; 

■ Furthermore, the method for receiving a multimedia message according to the 
invention allows the use of a single type of notffication message to infomi a 
1 0 recipient MMS user agent that a multimedia message is available for download. In 
other woTtis, a single notification message type may be used regardless of the 
media content of a particular multimedia message. This has the advantage of 
simplifying the fomiation of notification messages and allowing the availability of 
multimedia messages for download to be Indicated In a consistent manner. 

Advantageously, Session Description Data (SDD) need not be generated for a 
particular streamable media component before it is known whether the MMS user 
agent will actually retrieve the media component in question and the resources of 
the multimedia messaging system can be spared by only generating the SDD 
20 when needed. 

Further, the MMS user agent that retrieves the streamable components of a 
particular multimedia message need not be the same as the MMS user agent to 
which the original notification was sent. If a user decides to retrieve the streamable 
25 components of the multimedia inessage with a temninal other than the MMS user 
agent to which the notification message was sent, or with preferences other than 
the typical ones, It Is still posjslble to establish a streaming session conectly 
despite possible differences in tHe streaming-specific capabilities of the terminals. 

30 Advantageously, the streaming! adaptation Infomnation of the user agent allows 
generation of the SDD dependent on the properties of and / or preferences related 
to the terminal that actually rettiieves a streamable component of th multimedia 
message. 
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Prel rably, th streaming adaptation information comprises information on the 
user agent's capabiliti s to stream data and / or user preferences relating to 
Streaming. 

5 Preferably, the detemiinatlon if the multimedia message comprises a component 
that can be streamed to the user agent takes into account the streaming 
adaptation Information. 

Advantageously, using the streaming adaptation Infonnatlon It is possible to 
Identify the media components which the user agent is actually able to stream and 
which are not excluded by user preferences. Hence, the user agent is able to 
stream all media components determined as being streamable. Further 
advantageously, the user preferences may exclude particular media components 
from being streamed despite their streaming being supported by the capabUMes of 
the user agent. This exclusion can; depend on criteria such as media type, size, 
estimated cost or duration of transfer, in both the aforementioned situations, 
unnecessary generation of the SDD can be avoided. This results in a reduction of 
the computational load on the messaging system as not all user agents are able to 
stream all potentially streamable media components. Additionally, all user agents 
will not always require streaming of ;aii possibly streamable components. 



10 



15 



20 



25 



Preferably, the step of obtaining of the streaming adaptation infomnation takes 
place on receiving the retrieve request. Advantageously, obtaining the streaming 
adaptation information on receiv^g the retrieve request allows the same 
procedure to be used irrespective of whether there are streamable components 
and how they should t>e streamed. 



Preferably, the step of obtaining of 
on infomnation contained in fine 
30 streaming adaptation Information 
adaptation information may be 



received 



Preferably, the step of obtaining 



the streaming adaptation information is based 
retrieve request Advantageously, detailed 
or a reference to such detailed streaming 
in, or together with, the retrieve request. 



Df the streaming adaptatfon information takes 
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place aft r rec iving the r trieve request. Advantageously, the obtaining the 
streaming adaptation inlormation after receiving the retrieve request allows 
receiving the adaptation infonnatlon by an errtity thai also generates the SDD. This 
allows a great level of flexibility as the provisioning of the adaptation infbnmation 
5 takes place between the two parties that will be responsible for streaming, 
resulting in ease of upgrading of streaming in the multimedia messaging service. 

Preferably, the step of obtaining of the streaming adaptation information is based 
on information contained in communication received subsequent to the retrieve 
10 request. Advantageously, the streaming adaptation infomiation may be received 
from the user agent in a communication such as an RTSP describe signal. 

Preferably, the step of replacing the streamable component with a descriptor takes 
place at an MMS relay. Preferably, the step of generating the SDD takes place at 
15 an entity other than the iVIMS relay such as an MMS sender. 

Advantageously, a recipient MMS relay need not support any session description 
protocols and need not be capable of understanding in detail the slreaming- 
specHlc capabilities of the recipient MMS usei-, as the generation of the Session 
20 Description Data is perfonned by the media server. SDD. These two factors 
reduce the complexity of the MMS relay implementation compared with MMS 
implementations in which the MMS relay is required to generate the SDD. 

Furthermore, because the recipient MMS relay is not required to generate SDD, it 
25 need not necessarily perform extensive manipulation of the message content 
SDDwhen replacing streamable. media components with descriptors. This reduces 
the expected workload of the MMS relay and may increase the number of recipient 
MMS user agents that an individual MMS relay can handle. Alternatively message 
delivery times may be reduced as a result of the lesser woridoad placed on the 
30 recipient MMS relay. 

Preferably, the gen ration and provision of SDD is distrilHit d and is performed by 
different servers. Advantageously, a dynamically xpandable and flexible system 
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results, as the requirements f r a Multimedia Messaging Service Centre 
(combination of on or more MMS relay and one or more MMS sen«r) will b© 
reduced compared to the prior art. 

5 Advantageously, adopting the method of sending a multimedia message according 
to the invention increases the flexibility of a muhimedia messaging system and 
reduces the requirements placed on MMS relays writhin the system. 

Furthermore, new streaming capabilities can b© introduced Into the multimedia 
10 messaging system without requiring changes to the multimedia messaging relay 
that is responsible for notificalion and message deliveiy. This advantage arises 
because the generation of SDD can be perfomied by dedicated multimedia 
senrers (media senders) separate from the multimedia messaging relay, in this 
way. th© multimedia messaging system can be upgraded to use ever more 
15 sophisticated streaming protocols. An upgrade to a more sophisticated streaming 
protocol can be implemented by making the necessary changes to the media 
senrer and MMS user agents, while changes to the multimedia messaging relay 
are not necessarily required. 

20 According to a second aspect of the invention there is provided a method for 
receiving multimedia messages by a multimedia messaging user agent from a 
multimedia messaging network in a mobile multimedia messaging sen/Ice wherein 
user agents receive multimedia message notifications notifying the presence of 
multimedia messages and send retrieve requests to subsequentty receiv 
25 multimedia messages, comprising the steps of: 

sending a multimedia message retrieve request to the networi^ for receiving a 
multimedia message and providing the network with streaming adaptation 
information after the network has sent a notification for the mulUmedia message; 

receiving from the network a multimedia message transmission 
30 corresponding to the multimedia message retrieve request; 

obtaining from th© received multimedia message transmission a descriptor 
pointing to a remote location In the networic; 

obtaining session descriptton data to stablish a streaming session for 
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retrieving a str amable component from the remote location indicat d by the 
descriptor in accordance with th streaming adaptation Information; and 

e^ablishlng a streaming session in accordance with the session description 
data to retrieve a streamable media component. 

5 

Advantageously, providing the network with streaming adaptation infomiatlon after 
the notification has been sent aiiows customisation of the SDD so that it is 
appropriate to the user agent. 

10 Preferably, the streaming adaptation information provides streaming-specific 
capability infomnation relating to particular user agent terminal or infomiation 
concerning the streaming preferences of a user of that terminal. Advantageously, 
by providing the user agent capability information, the SDD can subsequently be 
generated in the network such that the user agent will be capable of streaming in 

15 accordance w'rth the Session Descriptton Data. Advantageously, providing the 
streaming preference Information allows customised generation of Session 
Description Data so that streaming can be performed In conformance with user 
preferences. 

20 Preferably, the multimedia message comprises both streamable and non- 
streamable components. Advantageously, non-streamable components can be 
Immediately presented to the user whilst the streamable components an^ retrieved 
separately and presented either separately or together with non-streamable 
components. 

25 

Preferably, the multimedia message is transferred over a wireless communication 
channel to the user agenL Preferablyi the multimedia messaging network is 
implemented in a cellular radio network such as GSM. UMTS, PDC, IS-95, or 
CDMA-2000. 

30 

Preferably, the SDD contains information determining how a streamable 
component should be presented. Advantageously, captk>n texts, control icons, 
background melodies and / or ex cutable applets relating to the multimedia 
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message can be provided as non-streamablo components and link d to a 
slreamable component or components by the SDD so that the message can be 
composed at the recipient device in a concentrated manner. Hence, a great 
degree of design freedom can be obtained to create Imposing multimedia 
5 messages. This is particularly advantageous in advertisement messages. 

According to a third aspect of the invention there is provided a multimedia 
messaging network entity for sending multimedia messages to multimedia 
messaging user agents In a mobile multimedia messaging service, comprising: 
10 a port for receiving a multimedia message retrieve request for a particular 

multimedia message from a multimedia user agent; 

means for obtaining streaming adaptation Infomiatlon of the user agent that 
requested the multimedia message and for determining if the multimedia message 
addressed, to a multimedia user agent comprises a component that can be 
1 5 streamed to the use r agent, responsive to recelvin g the retrieve request; 

means for replacing the streamable component with a descriptor pointing to 
session description data for the streamable component and sending the 
multimedia message wrth the descriptor replacing the streamable. component to 
the user agent, responsive to detennining that the multimedia message comprises 
20 a streamable component; 

means for generating, according to the adaptation Infonnatlon, session 
description data to establish a streaming session for delivering the streamable 
component; and 

means for establishing a streaming session In accordance with the session 
25 description data with the recipient user agent to deliver the strearriable component. 

According to a fourth aspect of the invention there is provided a multimedia 
messa^ng user agent for receiving multimedia messages from a multimedia 
messaging networi< in a mobile multimedia messaging service wherein multimedia 
30 message notifications notifying for the presence of multlnrtedla messages are sent 
to user agents, comprising: 

a transmitter for sending a multim dia retrieve request to the networic for 
receiving a multimedia message and for providing the networic with streaming 
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adaptation information after the network has sent a notification for the mulUnnedia 
message; 

a receiver for receiving a multimedia message transmission corresponding to the 
multimedia message retrieve request; 
5 means for obtaining from the received multimedia message transmission a 

descriptor pointing to a remote location in the network; 

mesuis for obtaining the session description data from the remote location 
indicated by the descriptor in accordance with the streaming adaptation 
information; and 

10 means for initiating a streaming session in accordance with the session 

description data to retrieve a streamable media component. 

Preferably, the muilimedia messaging user agent is a portable device. Even more 
preferabiyp the user agent is a hand portable or wearable device, 
15 Preferably, the multimedia messaging user agent comprises a mobile telephone, a 
wireless communication enabled PDA device, an electronic book or an electronic 
newspaper 

Preferably, the user agent is a stand-alone device. Alternatively, the user agent is 
20 at least partly implemented by means of an add-on module such as a PC-card or 
by means of executable program code operable at a communication device. 

According to a fifth aspect of the invention there is provided a system comprising a 
network entity according to the third aspect and a user agent according to the 
25 fourth aspect of the Invention. 

According to a sbrth aspect of the invention there is provided a computer program 
product for controlling multimedia messaging network entity for sending 
multimedia messages to multimedia messaging user agents In a mobile 
30 multimedia messaging service, comprising: 

computer executable program code for causing the networic entity to 
rec Iv a multimedia message retrieve request for a particular multimedia 
message from a multim dia messaging us r ag nt; 
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computer executabi program code for causing the netwoik entity to obtain 
streaming adaptation infomiatfon on the user agent that requ sted the muttimedla 
message responsive to receiving the retrieve request; 

computer executable program code for causing the network entity to 
5 determine if the multimedia message addressed to a user agent comprises a 
component that can be streamed to the user agent, responsive to receiving the 
retrieve request; 

computer executable program code for causing the network entity to 
generate, according to the adaptation infomnatlon, session description data 
10 "" to establish a streaming session for delivering the streamable 

component; 

computer executable program code for causing the network entity to 
replace the streamable component with a descriptor pointing to the session 
description data for the streamable component and sending the muttimedla 
15 message with the descriptor replacing the streamable component to the user 
agent, responsive to receiving the retrieve request; and 

computer executable program code for causing the network entity to 
establish a streaming session in accordance with the session description data with 
the user agent to deliver the streamable component. 

20 

According to a seventh aspect of the invention there is provided a computer 
program product for controlling muHimedia messaging user, agent for receiving 
multimedia messages from a multimedia messaging network in a mobile 
multimedia messaging service wherein multimedia message notiflcatfons notifying 
25 for the presence of muHlmedia messages are sent to user agents, comprising: 

computer executable program code for causing the user agent to send a 
multimedia retrieve request to the network for receiving a multimedia message and 
for provWlng the networit with streaming adaptation Information after the network 
has sent a notification for the multimedia message; 
30 computer executable program code for causing the user agent to receive a 

multimedia message transmission connesponding to the multimedia message 
retri ve request; 

computer executable program code for causing the user agent to obtain 



14/lX '02 16:55 F AX 01252 8850S0 NOKIA IPR DEPARTMENT UK PO . @019 



16 

from the received multimedia message transmission a descriptor pointing to a 
remote location in tlie networic; 

computer executable program code for causing tlie user agent to obtain the 
session description data from the remote location indicated by the descriptor in 
5 accordance with the streaming adaptation infonmation; and 

computer executable program code for causing the user agent to establish 
a streaming session In accordance with the session description data to retrieve a 
streamable media component. 

10 It should be appreciated that the embodiments of any one aspect may produce 
advantages when combined with other aspects of the invention and that they can 
be combined where applicabie, even though not alt embodiments are expressly 
v^itten after all aspects. 

15 The invention will now be described, by way of example, with reference to the 
accompanying drawings, in which: 

Fig- 1 shows an oven/iew of WIIS/IS system elements according to 3GPP TS 

23,140, V. 4.1.0; 

20 Fig- 2 shows an overview of inter-workIng MMS system elements according 

to 3GPP TS 23.140, V. 4.1 ,0; 
Fig. 3 shows the flow of signalling on receiving a multimedia message, 

according to a preferred embodiment of the present invention; 
Fig. 4 shows a flow chart describing the operation of an MMS relay / 

26 server, according to a preferred embodiment of the present 

invention; and 

Fig. 5 shows a block diagram of the structure of an MMS user agent, 

according to the preferred embodiment of the present invention. 

30 Figures 1 to 2 were described in the foregoing to illustrate the prior arL They also 
form a framework within which the present invention can be implemented. 

The op ration of a multimedia messaging syst m according to the invention will 
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now be described in an exemplary manner. In the following description. It will b 
assumed that the multimedia messaging system \v> Implemented in a 3rd 
generation mobile communication system. It should be 
system according to the invention may also be implemented in various other 

5 mobile communications systems based on difTsrent technologlea and 
communication protocols. For example, an MMS systeirJ according to the invention 
may also be provided in a GSM-based mobile commun^tlon networic. If the GSM 
networi< is implemented according to the requirements of the General Packet 
Radio System (GPRS), the details of signalling between the elements of the MMS 
10 system and the mobile communication networit will correspond substantially with 
the description provided below. In mobile communication systems based on 
different technologies and communication protocols,] interaction of the MMS 
system and the underiying communication networi<! may be affected In an 
equivalent manner, although the exact details of the signalling required may differ 

15 from those presented In the following example. 

Analogous to the previously presented description of prior art, the situation will be 
examined In which MMS user agent A In Multirhedia Messaging Service 
Environment A (MMSE A), sends a multimedia message to MMS user agent B, 
20 which Is resident In Multimedia Messaging Senrice Envlronnrient B (MMSE B). 

i 

When initiating the communication of a multimedia mesfeage to MMS user agent B, 
MMS user agent A first selects the media content to transmitted. As previously 
described, the media content may be of a non-streatpable type, such as a still 
25 Image and some associated text, stored in the memor^ of user agent A, or it may 
be of a type suitable for streaming, such as an kudio or video clip, or a 
combination of both non-streamable and streamable rjiedla content types. Some 
of the media contents may also take the form of URls br URLs Indicating networic 
locations from where particular media components may be obtained. 



30 



MMS user agent A encapsulates the media content jas a multimedia message, 
comprising the media content itself. informaUon n ce^ry to d scrib the media 
content and addressing infomnation. Identifying th i Intended recipient of the 
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messag . It th n sends the message to MMS relay A through radio network A. On 
receiving the multimedia message, MMS relay A deterrnines, from the addressing 
Information included with the message, that the intended recipient is not a user 
agent of MMSE A, but a user agent of MMS relay B In MMSE B and fonArards the 
5 multbmedia message to MMS relay B. 

The signalling related to delivery of the multimedia message to MMS user agent B 
according to the preferred embodiment of the present invention will now be 
described with reference to Fig. 3. When the multimedia message addressed to 

10 MMS user agent B arrives at MMS relay B, it stores the media content of the 
message in MMS server B and sends an MMS notification signal 310 to recipient 
MMS user agent B. Responsive to receipt of the notification signal, MMS user 
agent B replies with an MMS notification response signal 311. Later, or optionally 
as part of signal 311, MMS user agent B sends an MMS retrieve request signal 

15 312 to MMS relay B. MMS relay B responds by sending a modified multimedia 
message, comprising non-streamable media components and descriptors 
representing any streamable media components, in an MMS retrieve response 
313. Responsive to receiving the MMS retrieve response 313, MMS user agent B 
sends an MMS aoicnowledgement signal 314 to MMS relay B. According to the 

20 preferred embodiment of the present Invention, the descriptors used to represent 
streamable media components do not themselves provide Session Description 
Data (SDD) to be used by MMS user agent B In establishing a streaming session. 
Instead, they take the fomn of pointers, for example URI's or UIU.'s to locations 
where SDD can be obtained. 

25 

Using the descriptors, MMS user agent B can invoke a streaming process to 
download the streamai^Me media components one by ohe. The streaming process 
to download a particular media component is Initiated- controlled and terminated 
by exchanging signals 315 to 323, as Illustrated in Fig. 3. In the preferred 
30 embodiment of the invention signals 315, 316, 317, 318, 320, 321 and 322 are 
implemented using the Rea^Time Streaming Protocol (RTSP). in an alternative 
embodiment of the Invention the Hypertext' Transport Protocol (HTTP) Is used 
Inst ad of RTSP to provide thes signals. Two or more streaming process s can 
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take place at the same time so that th recipient MMS user agent can play or 
present two or more streamable media components almuhaneously. In this case 
signals 316 to 323 are exchanged for each streamable media component. 
Typically, the playing of the streamable media components is synchronised by 
5 means of commonly used protocols such as Synchronised Multimedia Integration 
Language (SMIL) definitions provided together with the SDD. 

To enable the streaming process for a certain streamable media component 
represented by a particular descriptor, MMS user agent B requests SDD relating to 

10 the media component from MMS server B. In Fig. 4, this request is represerrted by 
signal 315 and according to the prefenred embodiment of the invention, it is made 
using a Real-Time Streaming Protocol (RTSP) DESCRIBE method that identifies 
the streamable media component in question. In response to the RTSP 
DESCRIBE method signalling. MMS server B provides a response signal 316 

15 containing the SDD. 

In the prefened embodiment of the invention, signal 315 Is also used to infomi 
' MMS senrer B about capabilities of MMS user agent B. This fomns an association 
between the streamable media component requested in signal 315 and the 
20 recipient MMS user agent requesting the media component. It further allows the 
mullimedla messaging system to create the SDD required by MMS user agent B to 
form a streaming session with MMS server B at the time a streaming session Is 
actually being Initiated. As a result, the SDD Is only created when needed. It also 
follows that if a particular streamable media component Is not retrieved for some 
25 reason, no SDD is created for that component. Furthemiore. since the SDD is 
created only at a stage substantially immediately prior to or during establishment 
of a streaming session to download the media component, MMS server B can 
create the SDD so that it is tailored specifically for the recipient MMS user agent. 
This means that the user can stream a particular streamable component to an 
30 MMS user agent other than that which received the MMS notification and / or th 
MMS retrieve response 313. Arthough the user may have changed the recipient 
MMS user agent, an appropriate streaming session may sUII be established and 
the streamable component will b r c Ived In a fonnat suitabi for the equipment 
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used. 

Advantageously, the capability information provided to MMS server B is obtained 
from a user equipment capability database 1 60 that contains information about the 
5 technical capabilities of different MMS user agents and / or user preferences 
concerning different MMS subscribers. In this case, signal 315 is typically fonmed 
in accordance with 3GPP Technical Specification 26.234 Version 5.1.0 section 
A.4. Accordingly, MMS user agent B includes one or several Uniform Resource 
Locators (URLs) in signal 315. These URLs point to locations in one or several 
10 user databases 160 from where MMS sen/er B can retrieve capability profiles or 
streaming adaptation information, that is. information describing device capabilities 
and / or user preferences. This list of URLs is encapsulated in RTSP protocol data 
units using additional header field(s) and transmitted from MMS user agent B to 
MMS server in the RTSP DESCRIBE method signalling. 

15 

Alternatively, signal 315 may contain all the necessary capability and / or user 
preference information for MMS server B so that MMS server B can autonomously 
generaie the SDD suitable for the recipient MMS user agent 

20 Advantageously, the capability information relating to a recipient MMS user agent 
includes at least information about the streaming-specific capabilities of the MMS 
user agent Alternatively, the capability information may be more comprehensive 
including, for example, infonmation relating to the display or audio reproduction 
capabilities of the MMS user agent 

25 

In response to signal 315, MMS server B forms SDD taking into account the 
capabilities of the recipient MMS user agent, as described above, and replies by 
sending the SDD to MMS user agent B, in signal 316, for example in the form of a 
Session Description Protocol (SOP) file. Using the SDP file, MMS user agent B 
30 then sends an RTSP SETUP signal 317 to MMS server B In order to initialise a 
streaming session. MMS server B responds by sending an RTSP SETUP 
response signal 318 to MMS user agent B. 
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After having successfully mitialls d a streaming jsession with MMS server B using 
the RSTP SETUP method, MMS user agent B starts streaming th mectia 
component from MMS server B. In the present efcample, in which the MMS system 
is Implemented in a 3rd generation mobile cbmmunlcation networic. It Is first 
5 necessary to activate a secondary Packet Data Protocol (PDF) context. Activation 
of the secondary PDP context enables the transport of data packets containing the 
media content from MMS server B to MMS usdr agent B. in order to set up the 
secondary PDP context MMS user agent B signals 319 with a Serving General 
packet radio service Support Node (SGSN); of the mobile communteatlons 
10 network. Activation of the secondary PDP context and Its use In delivery of the 
media component using packet based communication is conducted In a manner 
known from 3rd generation / GPRS specificallorts. In embodiments of the invention 
Implemented in mobile communication systems; based on different communication 
technologies and / or protocols, alternative GRPS, other packet or ciiouit 
15 switched data services can be employed. : 

Following activation of the secondary PDP context, MMS user agent B starte 
streaming the media component by sending RtSP PI_AY signalling 320 to MMS 
server B. The streamable component is then streamed ^1 from MMS server B to 
20 MMS user agent B using the Internet Protocol (IP) / User Datagram Protocol 
(UDP) / Real-time Transport Protocol (RTP). 

After streaming of the media component has been completed, MMS user agent B 
terminates the streaming session by perfomhing RTSP TEARDOWN method 
25 signalling 322 with MMS server B. MMS user agent B next deactivates the 
secondary PDP context, as it is no longef needed to transfer the media 
component Deactivation of the secondary PDP context Is affected by signalling 
323 with the SGSN (see Fig. 4). ; 

30 As in the present MMS standard and as de^ribed In the aforementioned WO 
02/068349, SDD Is provided to the recipient MMS user agent before it can start 
down-streaming a streamable media competent Howev r, th SDD Is not 

embedded In the multimedia m ssage instead of a streamable component. 

'i 

i 
! 
I 

i 
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According to the present invent! n, only a brief streaming indication is provided for 
eacli str amable component. The brief streaming indication contains Information 
that enables tine recipient to obtain the SDD it requires to initiate a streaming 
session with the server where the streamable content is stored. In the preferred 
5 embodiment of the invention, as described above, the brief streaming indication 
takes the fonm of a pointer (such as a Uniform Resource Locator, URL) to a 
location where the SDD may be obtained. Advantageously, the provision of the 
brief streaming indication and its inclusion in the multimedia message requires the 
recipient MMS relay to perform only a few : operations. The brief streaming 
10 indication typically specifies an access type to ; use, such as RTSP or HTTP, an 
address of the server such as "mediasen^er.pom" and the identification of the 
content such as 7news/videoZ4 1 1 2002_1 23456*. 

It Is advantageous to an^ange the multimedia message such that the descriptor(s) 
15 representative of streamable media components are delivered in the early part of 
the multimedia message so that the streaming session(s) can be initiated as soon 
as possible, after downloading of a multimedia rfiessage has commenced. 

i 

Furthermore, according to the invention, the SDD is only generated on or after 
20 sending of the MMS retrieve request 312 by the recipient MMS user agent, 
according to the streaming-specific capabilitied of the particular User Equipment 
(U E) that is used as a streaming terminal. 

There are many ways to retrieve the SDD. In! addition to the RTSP DESCRIBE 
25 method, illustrated in connection with the preferred embodiment of the invention, 

other protocols such as HTTP GET or electronic; mail (E-mail) can be used. 

i 

1 

As described above, the SDD is arranged in jform of a session description file, 
such as a Session Description Protocol (SDP) file, which is a widely used session 
30 description file type. The session description ; file provides a description of the 
presentation for a particular streamable media component or components and 
allows the recipient MMS user agent to accdmplish media initialisation for the 
str aming process. SDP has a registered Internet Assigned Numbers Authority 

i 
t 
I 

I 

i 

i 
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<IANA) Muhi-purpose Intern t Meiil Extensions (NIIME) typ . 

Advantageously, the session description file corslalns the following data: a protocol 
version, infoimatlon about the owner and / o( creator of the media content, a 
session Identifier, a session name and at&ibutes, session infonnatlon, an 
originator identifier, such as the iB-mail address jor phone number of the sender of 
the multimedia message, connection infomiatlop. bandwidth Information, different 
time-related infomriation, and a title and attribute for each media component 
described by the session description file. The seission description file may further 
comprise some cryptographic Information, such as a Message Authentication 
Code (MAC), a cryptographic cl^cl^um for checking the validity of the content, or 
a challenge for allowing the recipient MMS userjagent to generate a session key to 
be used for decrypting or validating the cortent.) 



15 In alternative embodiments, other fomis of files are used for this purpose. TEXT 
files and files compliant with the Multimedia and Hypennedia Information Coding 
Experts Group (MHEG) ISO/I^C standard 135122 may also be used for this 
purpose. All these file types have a registered MIME type. 



20 Generation of SDD dependent cjn the capabilities of the UE actually used to down- 
Stream a streamable media colmponGnt provides the MMS system witli a great 
degree of flexibility, since MMSj server B can^dapl to the UE used each time a 
streamable component is to be down-streamed.. 



25 The entire multimedia message ban be uploadedlto the recipient MMSC 224 either 
by streaming or by any other appropriate method. In the preferred embodiment of 
the present invention, use of sfeamlng in downloading media content to a given 
recipient MMS user agent is inc ependent of the manner in which the content was 
uploaded to the MMS relay B 224. 



30 



401 . In block 402, MMS relay 



Fig. 4 shows a flow chart desert jing the operatip^i of MMS relay B according to the 
prefenned embodiment of the present invention 



Th operation starts from block 
B receiv s a rhililtlm dia message. In block 403, 
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MMS relay B attempts to notify the recipient user agent (MMS user agent B) with 
I^MS notification 310 tliat the mijiitlmedid message is now availabi to for delivery. 
MIS/IS relay B then checlcs in blcjck 404 if an MMS notification response 31 1 has 
been received, acknowledging the receipt of the MMS notification 310. If the MMS 
notification response 311 has bejen received, the operation proceeds to block 407, 
otherwise A is checked in block 405 if the MMS notification 310 has expired. If yes, 
the operation returns to block 4G|2 via an optional block 406 where the multimedia 
message is cleared. Instead ofj clearing the multimedia message at block 406, 
MMS relay B may erase the mjultimedia message at a later stage^ for example 

when more storage capacity is needed or when the multimedia message reaches 

t' 

a predetermined age. if the multimedia message has not expired at block 407, 
MMS relay B again attempts to | notify the recipient user agent at block 403. The 
loop including blocks 403, 4Gj4 and 405 is repeated until either the MMS 
notification 310 expires or an MMS notification response 31 1 is received. Typically, 
expiry of the MMS notification is a condition depending on a time limit and / or a 
number of attempts. For exam^^ie, MMS relay B may send the MMS notification 
31 0 up to ten times within an interval of up to 60 minutes so that the recipient user 
agent will be likely to succeed inj receiving the MMS notification 310. 



20 



25 



30 



The MMS retrieve request 312jmay be integrated with the notification response 

i 

311, if the MMS retrieve request message 312 would in any case be transmitted 
shortly . (for example, 1, 5 or 10 minutes) after the MMS notification 
acknowledgement 31 1 , or if Automatic downloading of incoming multimedia 
messages has been selected. 



Blocks 404 and 405 may further 



check if a cancellation of the multimedia message 



has been received from the originator of the message or from an MMS operator 
acting as a moderator. It the multimedia message has been cancelled, the 
operation returns to block 40^ via block 406 and the multimedia message is 
cleared. 



Aft r successfully notifying tlie 
messag , MMS relay B starts 



recipi nt MMS user agent about the multimedia 
polling (blocks 407 and 408) the reception of an 
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MMS retrieve request messag 312 until expiry of condttione reletting to delivery 
the message are fuffilled. These conditions typically includ an expiry time and / or 
a date after which the multimedia message will no longer be maintained. If the 
expiry conditions are fulfilled the operation jumps from block 408 to block 406 and 
5 the multimedia message is cleared. 

Next, in block 409, MMS relay B checks If the multimedia message contains any 
components that can be made available to the recipient MMS user agent by 
streaming. If yes. the media components that can be made available by streaming 
1 0 are replaced with descriptors and the procedure continues to block 410. 

In block 410, MMS relay B modifies the multimedia message by replacing the 
media components of the multimedia message that can be streamed to the 
recipient user agent with respective descriptors. It further stores the streamable 
15 components. In an MMS server (MMS sewer B) associated with the MMS relay B 
224. MMS sen/er B may be integrated with the MMS relay B or may be a different 
physical entity, in which case the MMS relay B sends the streamable components 
to the separate MMS server for storage. . 

20 The determination of streamablHty in block 409 may depend on various criteria, 
such as the capabilities of MMS server B. the capabilities of the recipient MMS 
user agent received, in the MM$ retrieve request 312 and the type of the media 
content (audio, video etc.). MMS relay B may maintain a pre-defined list of content 
types which are streamable for use in determination of streamability. Optionally, 

25 the recipient MMS user agent can Indicate the content types it Is able to stream in 
the MMS retrieve request signal ;31 2. Altemalively, MMS server B can be arranged 
to make the detemiination of; streamability at block 409. In this alternative 
Implementation. MMS relay B need not be informed of the capabilities of MMS 
server B. 

30 

According to the invention, an [MMS system can be constmcted with numerous 
interconnected MMS relays so ithat the capabilities of the various MMS servers 
associated with the relays can bj used to their full advantag . More specifically. If 
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25 



30 



a multimedia message comprising 
components is delivered to a paiticular 
is not streaming capabie, storage^ 
a streaming capable MMS serve^^ 
system. When a new MMS 
capabilities of a particular MMS 
starts making use of the enhanced 



It should be appreciated that since the question of 



10 MMS relay B before receiving 



as the recipient MMS user ageni 
capabilities of the UE actually u 



26 



ia 



on or more 
MMS reia^ 
of the multimedi 
associated with 
sjerver is added 
server are 
features therebjy 



receives notification of the multlnedia message rnay freely choose to use any UE 



potentially streamable media 
whose associated MMS server 
message can be transferred to 
another MMS relay in the MMS 
into an MMS system, or the 
enhanced, the system automatically 
provided to the system. 



streamability is not examined by 



the MMS retrieve request 31 2» the user who 



multimedia message. Thus, the 
)articular media component of a 



for retrieving the 
ed to retrieve a 

multimedia message can be t^ken into accourit both in the determination of 
whether that component may b^ downloaded by streaming and in the generation 
of the SDD. If, for example, the rjBcipient user agent is changed from a device with 
very limited software and hardware resources to another with superior capabilities, 



MMS relay B can adapt to the change; Thus, the 



affect the decision made by MMS relay B conoeming the streamability of a 



20 particular potentially streamable 



quite likely that exchanging an MMS user agent 



having higher specifications will 



to be actually downloaded by streaming. 



these 



Alternatively, instead of performihg 
410 entirely in MMS relay B, 
More specifically, the system 
determines which media con* 
components with descriptors, 
streaming related intelligence 
Furthermore, the streamability o 
capabilities and / or preferences 
capabilities and / or preferences 



media componerL In the example Just given, it is 



enable more po^ 



with lower specifications for one 
entially streamable components ; 



be 



the operations 
tasks may 
can be 
ponents are 
This is 
from MMS 
media 

of the recipient 
of MMS servdr 



advantageous 
relay 



change in user equipment may 



associated with blocks 409 and 
performed by MMS server B, 
implembnted so that MMS server B 
streamable and replaces these 
since it further moves 
B to the MMS server B. 
componejnts may not only depend on the 
I^MS us r agent, but also on th 
B. Hence, MMS relay B can 
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substantially avoid processing related to streaming. 

In block 411, after or substantially simultaneously with the storage of the 
streamable components, MMS s0n;er B delivers the modified multimedia message 
5 comprising non-streamable media components and descriptors representing 
streamable components to the recipient user agent. 

At block 412 MMS relay B then: receives an MMS acknowledge signal 314 from 
recipient MMS user agent B. The procedure then continues to block 413, where 

10 the recipient MMS UA sends the signal 315 to MMS sen/er B, requesting provision 
of the SDD relating to a particular streamable media component. As described in 
the foregoing, the recipient MMS user agent provides MMS relay B wtth capability 
information, thereby making ari association between the capabliitres of the 
recipient MMS user agent and the particular streamable media component to be 

15 downloaded. Having the capability association, MMS server B can generate the 
SDD taking into account the capabilities of the recipient MMS user agent. In an 
alternative embodiment of the Invention, the recipient MMS UA 1 10B sends signal 
315 to MMS server 224 before sending acknowledgement signal 31 4 to MMS 
relay B 224. 

20 

in block 414, MMS sen/er B next generates the SDD and sends it in signal 316 to 
the recipient user agent that requested deliV0iy of the media component, typically 
In form of an SDP file. 

25 After providing the SDD to the recipient MMS user agent, MMS server B initialises 
a streaming session, starts streaming the data, and tears down the streaming 
session when streaming of the !media component is complete. These steps are 
repeated for each streamable component requested. As explain^ in the 

i 

foregoing, more than one streanhing process cauri be performed in parallel so that 
30 the recipient MMS user agent can present two or more streams simultaneously. 
Advantageously, in this case, RTSP SETUP signalling is completed for each 
streamable component to be delivered before streaming off th media components 
is actually started by Issuing t^\e RTSP PLAY method signalling. Alternatively, 
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where simultaneous pres ntation of more than one streamable media component 
is not required, the steps of initialising a streaming s ssion, streaming the data for 
a particular media component, and tearing down the streaming session are 
performed consecutively for each streamable media component requested by the 
5 recipient user agent. 

After all the streamable components and non-streamabie components are 
delivenad, the procedure of delivering the multimedia message ends at block 416. 
Typically, an MMS relay and an MMS server are implemented as a server 

10 computer controlled by a computer program, which enables the MMS relay and 
MMS server to operate according to the aforementioned steps. In a manner typical 
of such computer-based implementations, the MMS relay and MMS server are 
able to multitask, continuously monitoring incoming messages and processing 
them so that the MMS relay and MMS server can serve numerous recipient MMS 

15 user agents simultaneously. It should also be appreciated that the MMS relay and 
MMS server may simultaneously be involved in delivering more than one 
multimedia messages addressed to particular recipient user agent. In this case, 
the MMS relay and MMS sender establish two or more parallel processes 
according to Fig. 4 for a single MMS user agent, so that the processing of 

20 different, simultaneously pending, multimedia messages is in largely independent, 
particularly with regard to the reception and notification steps 402 to 40B. 

Whilst typically the same MMS server, or server, may store all the components of 
a particular multimedia message, some of the components may be distributed on 
25 different servers. For example,: a streamable cornponent may be stored on a 
particular content provider's own MMS server and in this case the pointer to such a 
component would refer to a different server than that storing other streamable or 
non-streamabie components. 

30 Fig. 5 shows the structure of^an MMS user agent according to a preferred 
embodiment of the present invention in which the MMS user agent is Implemented 
in a wireless communication d^ vice. A microprocessor \iP controls the blocks 
~ fespprisiBieTfor the MMS user ajg hfs vanbdsTunQi^^ blocks 
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compris a random access mentery RAM, a radio frequency block RF, a read only 
memory ROM. an input / outputixm I/O for xtemal connections, a user int rface 
Ul, having an audio system S||d and a display DPL for presenting multimedia 
messages and a keyboard KB[| for receiving data and commands from a user. 
5 The microprocessor's opsratfng instructions, that Is program code for 
implemenling the MIVIS user agents basic functions are stored In advance, for 
example during the manufacturing ; process, in the ROM. In aocorelance with Its 
program, the micrxaprocessor u'pes the RF block for transmitting and receiving 
messages on a radk) path. The microprocessor monitors the state of the user 
10 interface Ul and controls the MMS user agent according to the program code. On 
receiving a multimedia messag|, tine microprocessor jiP examines the message 
for a brief streaming indicator ©(descriptor representing a streamable multimedia 
component. If it finds such a descriptor, it will cause operation in compliance with 
steps413to415 0f Rg. 4. | 

•IS .'■ • 

Typtoally, the recipient MMS usW agent sets up streaming sessions immediately 

after recerving SDD. Altematlv|ly, the recipient MMS user agent can store the 

SDD in its memory for use at so|ie later time to Initiate a streaming session. In this 

case, there will be a substantial! delay between reception of the SDD and starting 

20 the down-streaming of a particular streamable media component. 

i : 

If a particular multimedia comp<|nent is of a type not supported by the MMS user 
agent itself, the microprocessorfmay control the Input / output port I/O to fonward 
such a component to an exter|ar device that supports that type of multimedia 
25 component. Such an external "device may be a personal computer, typically a 
laptop computer. This also provides the advantage of allowing use of enhanced 
user Interface and sound capabijities, If the external device provides such facilities. 
The Input / output port may be a|i inlfrared port, a wired port, or a Low Power Radio 
Frequency connection port sutih as a Bluetooth port. When It is necessary to 
30 transfer presentation of a potlntially streannable multimedia component to an 
external device, the capability lar^meters provided to MMS sender B preferably 
con^espond to the capabilities <h Hi ejtlemal device. Furthemrwr , on this case, 
The SDD received frorri MMS"s^^r"BrBl)a^cnd the"extemal device to enable" 
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[ng session with MMS sever B, eith r via the l\^MS 
iich as fixed internet access. 



10 



15 



Preferably, mullimedia componeints of excessive quality are down-converted to a 
lower, but sufficient quality leveljeuch that their transmission Is faster and they can 
be readily used by the reclpletjit user agent without any further conversion or 
manipulation befoie prBseritaticin to the user. Similarly, multimedia components 
may be converted from one meaia format to another, such that the result conforms 
to the capabilities and / or prefetences of the recipient user agent The conversion 
can be made either beforehan<|or on / during transmission of the MMS retrieve 
response. 



Particular implementations ai 
described. It is clear to a person 




embodiments of the invention have been 
skilled in the art that the invention is not restricted 

to details of the embodiments pfesented above, but that It can be implemertted In 

In 

other embodiments using equivalent means without deviating from the 



characteristics of the invention, 
attached patent claims. 



he scope of the invention is only restricted by the 
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determining If the multimedifi 
component that can be streamec 

generating, according to thd 
to establish a streaming session 



replacing the streamable cohponent wftfi 



lla messages ^ motoW multim dia messaging 
ing user age its, comprising the steps of: 
age retrieve request for a particular multimedia 
Kaging user agient; and 

the steps of. 



Claims 

1 . A method for sending muftim 
service to multimedia messai 
receiving a multimedia me 
message from a multimedia me 
responsive to the retrieve reque^ :, performing 

obtaining streaming adaptat pn infomiation of the user agent that requested 
the multimedia message; 

message aci dressed to a user agent comprises a 
to the user CLCjent; 

adaptation information, session description data 
or delivering 



@034 



the streamable component; 
a descriptor pointing to the session 



description data for the streariable comporjent and sending the multimedia 

streamable component to the user 



ilacing the 



message with the descriptor r^ 
agent; and 

establishing a streaming session In acccirdance with the session description 
data with the user agent to delivir the streamat^le component. 



2. A method according to claii 
comprises information on tt 
user preferences relating to ^reaming 



1, wheiBin ihe streaming adaptation information 
comprises information on thq{|user agent's capabilities to stream data and / or 



3- A method according to claim 



25 message comprises streamaple componejifs takes into account the streaming 
adaptation infomnation. 



4. 



retrieve request. 



A method according to any 
ihenstreamlng ^adaptation In 



or 2, wherein^, the determination if the multimedia 



A method according to any f the precec iitg ciaims, wherein the obtaining of 
the streaming adaptation inf( rmation is ba^ed on information contained in the 



J r. : I : 
It 



!)f the prec djing claims, wherein the obtaining of 
%)nTiation is 



bksed on' lnf oirmmftftii x^ontained . in 
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muttimedia messaging relay, i 
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il 



6. A method according to anjro " 

replacing the streamable q|>m3onent wit^ a descriptor takes place at a 



the preceding claims, wherein the step of 



• ^ 

. 6, wherein: the step, of generating the session 



7. A method according to cl 
description data tal^es placej^t entity pt|ier than the muttimedia messaging 
relay. 

8. A method for receiving multii|iec)ia messages by a multimedia messaging user 
agent from a multimedia messaging netwQri| in a mobile multimedia messaging 
service wherein user agents recfeive multimedia message notifications notifying 

I'M ' P 

the presence of multimedia jmesaage$ [i and send retrieve requests to 
subsequently receive multimedia messageis| comprising the steps of: 
sending a multimedia message retrieve req.ubst to the network for receiving a 
multimedia message and proiidrng the network wrth streaming adaptation 
information after the network haa'sdnt a notific4tion for the multimedia message; 

receiving from the n||tw!(>rk a multimedia message transmission 



corresponding to the multimedia message retrieve request; 

obtaining from the receiv|d Inultimedia imessage transmission a descriptor 

'I'* i 

pointing to a remote location in t ie network; j ^ 

obtaining session descri^lon data tq establish a streaming session for 
retrieving a streamable compopert from thje^: remote location indicated by the 
descriptor in accordance with the streaming ajdiliptation infomiation; and 

^sslon In acdclrdance with the session description 



establishing a streaming 
data to retrieve a stieamable m^ 

9. A method according to clair 
provides user agent capabili 

.10. A method according to an^ 
■7~defSoription data comprises 



iia 



oompcneki 



wherein 



tie streaming adaptation Information 



inrormatlon 



prec^d 



or. the 

tj-i* J. I -•• . 

fifprrnatiOfrTi4ces^7>^^ a streaming 



ojr streaming preference information, 
"^^ing claims, wherein the s ssion 
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t)ie precedipg claims, wherein the multimedia 
a wireless communication channel to the user 

■i 

•1 

rorl^ entity fo^ sending multimedia messages to 



1 

lents in a mobile multimedia messaging service. 



12.A multimedia messaging net 
multimedia messaging user 
comprising: 

a port for receiving a multinjiedia meissage retrieve request for a particular 
multimedia message from a muljt|rn^ia user a^ent; 

means for obtaining streadftlg adaptation jtnfomiation of tire user agent that 
requested the multimedia messOTs ^nd for det^mnining if the multimedia message 
addressed to a multimedia ud|r ^gent corrtrises a component that can be 
streamed to the user agent, res|i jlnslve to receij/lng the retrieve request; 

means for replacing the stR ^mable compbnent with a descriptor pointing to 
session description data for [ |he; streamable component and sending the 
multimedia message with the 4 jscriptor risplating the' streamable component to 
the user agent, responsive to d4 prrhining that the multimedia message comprises 
a streamable component; } i ' '• ^ | 

means for generating, acitorcling to. th^ adaptation information, session 
description data to establish a f If reaming s^sjsion for delivering the streamable 
component; and J : i 

means for establishing a sliLai^ning session; in accordance with the session 
description data with the recipient u^r agent tcri deliver the streamable component 



13. A multimedia messaging us^^ 
multimedia messaging ne 
wherein multimedia mess 
multimedia messages are se 
a transmitter for sending 
receiving a multim dia messac) 
adaptation infomnation afterihe 



agent foH receiving multimedia messages from a 
rkjin a mobile multimedia messaging service 
i jnotificaticinB ; notifying for the presence of 
tq usbr agelnp; comprising: 
I rhultimedia retrieve request to the networic for 
eUid for; providing the network with streaming 
hiis 'sint a "notification for th multimedia^ 
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messag 



I 



a receiver for receiving ai;muHimedla n^ejssage transmission corresponding 
to the multimedia message retri^vja riaquestj; 

means for obtaining from |khe:i received multimedia message transmission a 
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descriptor pointing to a remote Iqdatibn in Itlie network; 

means for olstaining tlie |ession dpscriptidn data from the remote locatbn 
indicated by tiie descriptor tp accordiance with tlie streaming adaptation 
Infomrwition; and j 1 i I i 

means for initiating a strisraniiing Session In accordance with the session 

a 'l .1 I j * i I 

description data to retrieve a str^^mable m^dia component* 

^! ' I ! : j 



14.A mobile multimedia mess^qing seryrce system icomprising a multimedia 
messaging network for prociLssing multimedia messages addressed to a 
plurality of multimedia messaging usejriagentsf and ja plurality of user agents, 
comprising: h i ; j ' ! 

means for delivering a multiijnedia nh^ssage'; retrieve request from the user 
agent to tlie server; 

means located in the rie1w^rk!:for determining if jthe multimedia message 
addressed to the user agent conjiprises ajdomponeht thjat can be streamed to the 



user agent requesting the retrievia of the rpultimedia message; 

means located In the netwar e for replacing a streamable component in the 
multimedia message with a deL^riptor representing the streamable component 
and pointing to session descripljcin data Recording to vihich a streaming session 
can l3e established for delivery o|ihe| streeLrnable cbmpoKient; 

means k>aated in the n 



Irk fpr de leering the mjultlmedia message to the 
user agent responsive to the mu|r neidia message. Iretrieve request; 

means located In the Uj^erlageriitj for separatjing from the multimedia 



ocatlon In the network; 



message transmission a descriptjbr polntirfgito a rejnote 

user agent means for oonfolcting th^ networjc accprding to the descriptor 
means located in 
information on the user agent 



the |;;networlc| I for obtainirig streaming adaptation 



retrieve request; 

mean^iocated irril 




Qponsive'to receiving 



work: for; g^nerpting 



4 T- "fv 



the multimedia, message 
session ~cii^s»lption~ijffla'^ 
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5 media component. 



15.A computer program product 



for oeilvering the streamable 



necessary to establish a stn^Amlng ^^sion 
component according to the streaming adfLptationj informatton; 

means for establishing a stne^min9i4essiort between the user agent and the 
network using the session description cjdta In brder po deliver the streamable 



multimedia messaging network 



for controlling: 

entity for sending multimedia messages to ^mijlltlmedia messaging user agents 
in a mobile multimedia messaging service, comprising: 

computer executable proiram c6de for 'jcausihg the network entity to 



receive a multimedia message 



retrieve; requejst foij a particular multimedia 
message from a multimedia messlaging user agerit; ! 

computer executable program code for causing the network entity to obtain 
streaming adaptation information on the lisier agent that requested the multimedia 
message responsive to receiving.the retrieve request; i 

computer executable program code forlicausihg the network entity to 
determine if the multimedia message addressecl to si user agent comprises a 
component that can be streamecl to the | user agpnt, responsive to receiving the 
retrieve request; : . i; 

computer executable program code far jcausing the networi^ entity to 
generate, according to the adiiptatlon j infonn^tlon, isesston description data 
! to establish a streaming session |;for delivering the streamable 

component; = j . ; 

computer executable program code for ; causing the network entity to 
replace the streamable component witlji a de^priptor pointing to the session 
description data for the strearnable cdrtipohehit and! sending the multimedia 
message with the descriptor ndplacing the stre!^mable component to the user 

agent, responsive to receiving thd retrieval request and ! 

. • • . i1 j 
computer executable program code forijCausing the networtc entity to 

> I j I 

establish a streaming session in accbrdarlce with i^he se^fon description data with 

the user agent to deliver the streamable CDmponeiiL ! . 

:f ; . 1 i. . 

!|| . . j; : . I 

1 6 . A co mputerpogram product! for contrqlling n|iJltlm^^ agent 
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for rec iving multimedia m ssages from a multimedia m ssaging natwoik in a 

mobile multimedia messaciing service wh rein muitim dia message 

notifications notifying for the p lesence of- muHiinedia messages are sent to user 

agents, comprising: 

computer executable program code for ca using the user agent to send a 

multimedia retrieve request to the network for receiving a multimedia message and 

for providing the network with sti^eaming adaptation information after the network 

has sent a notifk;ation for the muli imedia mjsssagd; 

computer executable progj am codeifor causing the user agent to receive a 

multimedia message transmissii>n correspondirig to the multimedia message 

retrieve request; j 

computer executable program code = for causing the user agent to obtain 

from the received muitimecHa msssage transmission a descriptor pointing to a 

remote location in the network; 

computer executable program code |For causing the user agent to obtain the 

session description data from the remote' tocatioyi indicated by the descriptor in 

J • \ ' -it, 

accordance with the streaming adaptatton fntormation; and 

computer executable prx>gram code for caiiising the user agent to estedblish 

a streaming session in accordance with the; session description data to retrieve a 

streamable media component. 

17. A method substantially as 
accompanying drawings. 



lereinbefore descrit>ed with reference to the 



18. An apparatus substantially a^ hereinbefore ^escribed with reference to the 
accompanying drawings. 



19. A system substantially as 
accompanying drawings. 



lerelnbefbre described with reference to the 
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according to ttie sessio r»|| 



Fig. 3. 



metliod 



same multimedia mess ije carr 
both non-streamab!e m Ji'iB cortiwnerits and descriptors 
relating to streamable rnedia carijpojients'. A recipient 
extracts the descriptors from fl-e miJHfmedia message, 
contacts a server holding the stre imabie components and 
provides the server wit^i its caj:ab|iity data. The server 
accordingly creates ar c^^sendsjl aqlc session description 
data. The recipient lh((m initiWes streaming sessions 



in J s/8tem, wherein the 
M used to encapsulate 



escripii Dn data. 



*1 y> -yv 
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314MMS ACK 



315 RTSP : Describe 



317 RTSP: Setup 
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Activation . 



320 RTSP : Play 



322 RTSP : Teardown 



323 Secondary Context 
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410 



REPLACE 
STREAMABLE 
COMPONENTS 
WITH 

DESCRIPTORS 



DELIVER NON-STREAMABL 
AND DESCRIPTORS IF AN|Y 



MMS ACKNOWLfPfGE 
■ i 



l| components 5-41 1 



RECEIVE FROM UA SESSIppiJ DESCR. DATA 
REQUEST AND OBTAIN U/jk CAPABILITY DATA 



CREATE AND SEND SESSpN DESCRIPTION 
DATA REQUESTED TO THE liA 

i 




r 



413 



414 



SETUP STREAiyilNG SESSfcQNS,: STREAM 
STREAMABLE COMPONENlfe +:!rEARDOWN 



Fig. 4 
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